! 

I 


Rochester,  New  York  14627 


THIS  DOCUMENT  IS  BEST  QUALITY 
PRACTICABLE.  THE  COPY  FURNISHED 
TO  DDC  CONTAINED  A SIGNIFICANT 
NUMBER  OF  PAGES  WHICH  DO  NOT 
REPRODUCE  LEGIBLY. 


; ' 2 


X v- 


t Ac  c c- ...  y.-i  i1  c r 

c."  -i 

to;  TA3  H 

Ifcaaaouaced  H 

j Justification  ^ 


J&lstribi  __ 

— Av,a  iL  _i_  _•  Coc_r.fi 

I Aval  land/  or 
special 


Progressive  Refinement  of  Raster  Images 

' j c > Kenneth  R. /Sloan,  Jr.  - 

--''Computer  Science  Department 
University  of  Rochester 

Steven  L.;'Tanimoto 
Computer  Science  Department 
University  of  Washington 

/ '■  TR-39 


i / Nov 


I > 

J / 


abstract 


The  transmission  of  high  resolution  raster  images  over  low-bandwidth 
communication  lines  requires  a great  amount  of  time.  User  interaction  in 
such  a transmission  environment  can  be  frustrating.  The  problem  can  be  eased 
somewhat  by  transmitting  a series  of  low  resolution  approximations,  which 
converge  to  the  final  f image.  Several  methods  of  computing  such  a series  of 
images  are  presented.  Each  is  related  to  a particular  type  of  pyramid  data 
structure.  They  rely  on  the  ability  of  the  local  display  device  to  overpaint 
an  existing  image,  and  generally  require  some  transmission  and  computation 
overhead.  However,  one  of  the  methods  requires  no  transmission  overhead  and 
only  a small  amount  of  local  computation.  A notation  is  introduced  that 
permits  concise  descriptions  of  the  image  refinement  processes.^  r 
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1 YT  FGD1CT  IC  :J 

Raster  graphics  display  devices  are  capable  of  re  pi  oc  uci  a ; very 
complex  images.  Unfortunately,  they  are  often  connected  to  tne  source 
of  those  images,  a larqe  mainframe  computer,  bv  iow-bandwiutn  data 
links.  This  makes  it  difficult  to  interact  efrectively  with  tne 
display  when  it  is  being  used  to  display  the  images  for  « aj.cn  it  was 
made  (often  full-color,  tyoically  5 11*512  picture  elements  (pixels)). 
Transmitting  such  an  image  over  a 1200  maud  line  can  take  naxi  a.i 
hour,  or  longer.  If  it  is  being  displayed  on  a iine-bv- nre  oasis, 
than  it  may  be  15  or  20  minutes  before  tne  user  has  any  notion  or  wnat 
tne  final  picture  will  be  like. 


This  problem  can  be  alleviated  somewhat  ov  sensing,  and 
displaying,  a series  of  images  w hie  a converge  to  tne  ri»»ai,  full 
resolution  picture.  Successive  images  are  refinements  or  earlier 
images,  and  approximations  to  the  original  image.  The  primary 
advantage  of  such  a scheme  is  tnat  global  structure  in  t^e  i«i;e 
becomes  apparent  very  early  in  the  display  process,  ailo«  i ..3  tit  user 
to  begin  to  examine  the  picture,  and  even  interrupt  tne  display  wnv 
satisfied  with  the  approximation.  Tne  disadvantages  lie  ir.  (possibly) 
increased  storage  or  computation  costs. 


In  this  paper,  we  present  severa.  methods  of  computing  such  a 
series  of  converging  images.  All  of  t*.ese  metnods  are  rase!  upon 
pycamid  data  structures  [Taaimoto  and  Tavlruis,  I'aToj.  Ire 
dirforonces  between  the  met  nods  are  rt-iitei  to  t..e  caoicts  naut  in 


uesijn  of  pyramid  data  strut  a 


es. 
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PYRAMID  DATA  STRUCTURES 

A pyramid  data  structure  consists  or  several  levels,  numbered 
0-L,  where  each  level  is  a 2-dimensional  raster  image.  Levei  L is  the 
most  detailed  (finest  resolution)  imaqe;  tee  otners  are  derived  from 
it,  and  are  approximations  to  it.  (rig.  1)  Tna  value  of  a pixel  in 
level  k is  a function  of  tue  values  or  tne  pixels  in  an  MxU  window  in 
level  t+1.  Thus,  the  relevant  parameters  of  a pyramid  data  structure 
are: 

a)  X , Y : the  dimensions  of  Level  L, 

p)  M,N  : the  dimensions  of  the  reiuction  window, 

r)  R : the  reduction  rule. 

Usually,  the  reduction  window  and  the  original  image  are  square 
(M=N,  X = Y = (.1  **L)  ) , hut  these  conventions  can  be  relaxed,  at  some  cost 
in  computational  complexity.  The  reduction  rule  can  ne  anv  reasonable 
function  of  the  pixels  in  the  window  (e.g.,  dm,  Max,  lean.  Median, 
Mode,  Sum,  Selection,  or  their  extensions  for  handling  colored 
pixels)  . 

In  subsequent  sections  we  shall  introduce  formulas  wr.ic**  Leicr  to 


pixels  in 

pyramids,  and 

in 

order 

to 

simplify 

tne  se  references  • « 

denote  by 

U 

, i , 1)  the  pixel 

in 

level  k 

at 

the  it  a 

row , j tu  column. 

The  set 

of 

aii  pyramid 

pix 

eis  is 

?= 

{ (*,  i,  1>  1 

1 G< k<L , 0<l<A**k, 

0<i<N**k) 
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MOT  AT  I ON  FOR  RASTER  OPERATIONS 

Sc  a o<#  present  notation  that  can  conveniently  be  used  to  represent 
manv  of  the  processes  discussed  in  this  paper.  In  particular,  the 
notation  will  Demit  us  to  concisely  describe  the  progressive 
sequences  of  images  that  our  methods  produce.  we  begin  by  introducing 
several  "iconic  operators."  These  manipulate  iaaqe  data  by  acting  on 
grey-valued  (or  colored),  arbitrarily-shaped  regions  of  the  picture. 
More  precisely,  each  iconic  operator  is  either  a binary  operator 
(takir.q  two  operands)  or  a unary  operator  (taking  one  operand),  and 
takes  operands  which  ace  "colored  subsets  of  RR.  " RF.  (the  "raster 
reqion")  is  an  X hv  Y arcav.  Thus, 

RR  = f (0,0)  ,0,1)  , 0,1-1)  , 

1 1,0)  , ( 1,  1)  (1,1-D  , 


(X-1,0)  , U-  1,1)  ,...,(  X-1,Y-1)1 


Let 


C = CCq  ,C-j  , • . . »c^  -1} 
c 


be  a set  of  colors  (e.q.,  combinations  of  red,  green,  and  blue, 
realizable  on  a particular  raster  display  device)  . We  assune  that  two 
scociai  colors,  b^ack  a;.J  white,  are  in  C.  Then  if  ScrR  and  f:S->C, 
we  sav  (S,f)  is  i col  1 subset  of  F. R . An  alternative-  name  for  the 
colored  subset  of  RR  is  "partial  picture"  since  a colored 


concert  of  a 


J 
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subset  of  SF.  is  in  actuality  completely  described  by  the  partial 
function  f from  RR  to  C.  However,  the  explicit  mention  of  the  domain 
S of  f simplifies  our  subsequent  discussion  of  iconic  operators. 

For  completeness  of  our  basic  terminology,  we  let  F be  the  set  of 
all  colorinq  functions  f and  let  ^ be  the  restriction,  of  F to  {S}  . 

Thus  the  colored  subsets  of  HR  are  the  elements  (S,f)  of  such  that  dom(f ) 

The  repainting  operator , i,  is  a binary  iconic  operator  whose  action 
is  described  as  follows: 

(Sl’fl^  - (S2,f2}  = ^S3,f3J 

where 

S3  - S1  « S2 

• f j : Sg  -*■  C such  that 


f3(x,y)  = 


'f2(x,y) 

if  (x,y)eS, 

f (x,y)^ 

if  (x,y)fS2 

but  (x,y)  e S 

(undefined  otherwise) 


To  "repaint”  using  two  colored  subsets  of  P.E,  we  lake  the  resulting 
subset  be  the  union  of  the  two  given,  and  define  a coloring  function 
for  it  as  folicws:  the  pixels  common  to  the  two  oriqical  subsets  get 
the  color  from  the  second  subset.  All  other  pixels  of  the  new  subset 
get  +-he  color  originallv  assiqned  to  them.  It  is  easy  to  see  that  t 
is  associative  but  not  commutative.  Thus  we  write 
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% (si,fi)  = (s1,f1)  % (s2,f2)  %...  %(sn,fn) 

with  tha  understanding  that  the  order  of  the  terins  is  fixed, 
binary  iconic  operator  makes  use  of  distinguished  colors, 
white,  and  an  assumed  color  complement  permutation  tTc  :C->C 


IT  (7T  (c)  ) = C 

c c 


and 


it  (black)  = white, 
c 


The  left  complement  operator  /C  is  defined  as  follows: 


wnere 


(S^f^  $ ^S2’f2^  = ^S3’f3^ 


S3  = S1US2 


,(x,y)  = 


^f^Xjy)  if  (x,y)eS1  but  (x,y)  t S2 

f2(x,y)  if  (x,y)  t S1  but  (x,y)  e S2 

f.,(x,y)  if  (x,y)£S^  and  (x,y)  e S2 

and  f2(x,y)  = black 

iri=(f1(x,y))  if  (x,y)  £ S1  and  (x,y)  eS^ 

and  f2(x,y)  = white 
(undefined  otherwise) 


An o the  r 
black  and 
satis  f ying 
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la  the  left  complement  operation  a pixel  in  5^  coming  from  S/  keeps 
its  oriqinal  color  if  either  the  pixel  ioes  not  belong  to  S2  or  tne 
pixel  belongs  to  S2  and  is  colored  black.  If  the  pixel  from  S, 
belongs  to  Sr  and  is  colored  unite  (by  f2 ) the  pixel  is  given  the 
complementary  color  in  (S3,f3).  A point  in  but  not  in  S,  xeeps  its 
color  in  Sj.  The  operator  is  defined  so  as  to  permit  (S2,f2)  to  act 
as  a "switch  picture"  to  selectively  complement  colors  of  pixels  from 
(S, 

When  all  its  results  are  defined,  tne  left  complement  operator 
like  the  repainting  operator  is  not  commutative  but  is  associative. 
Thus  we  write 

n 

* (s.,f.) 

i=l 


with  unambiguous  interpretation. 

ie  will  use  another  operator,  tne  "blowup"  operator  as  ar. 
interface  between  pyramid  and  raster  representations.  Tuis  operator 
is  not  strictly  iconic  since  only  its  result  (rataer  than  both  its 
operand  and  result)  is  a colored  subset  of  EP.  Tne  blowup  operator  is 
defined  as  follows: 

3:  PXC-*'2RRXF 

B((k,i,j),c)  = (S,f)  where 

s = { (x,y)  | i*M**k<x<(i+l)*M**k,  and 
]*N**k<y<(j+l)*N**k  } 

and  f(x,y)  = c (uniformly). 
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The  blowup  operator  translates  a pvramid  pixel  and  its  color  into  a 
corresponding  region  in  the  detailed  raster  region,  colored  with  toe 
sue  color. 

Both  the  repainting  operator  and  the  left  complement  operator 
ta!<e  two  arquaents  and  are  thus  binary.  Althougi  we  shall  not  need  it 
here,  one  aay  define  a unary  complement  operator: 


<|cs1,f1)  = (s2,f2) 

where 

S2  = S1 

f2(x,y)  = ir  (f^Xjy)) 


I 


Page  ) 


NAIVE  .lETEOJ 

Assuminq  that  a pyramid  uata  structare  has  o^ec  built,  tnere  is  a 
straight-forward  display  technique  which  depends  only  on  tae  anility 
of  the  local  processor  to  mint  rectangular  regions  on  the  screen  (or 
in  a frame  buffer).  The  pyramid  is  si. a ply  transmitted  "top-down". 
Each  level  is  sent  in  the  usual  raster  scan  order,  and  used  to 
ovarpaint  the  existing  image.  First,  ievel  3 (1x1)  is  painted  as  a 
sinqle  block,  covering  the  entire  screen-  Than  level  1 (Hx.N)  is  sent 
and  displayed,  again  filling  the  entire  screen.  Successive-  levels, 
requiring  ever  increasing  amounts  of  time  to  transmit  and  display, 
serve  to  continually  refine  the  details  of  the  image  on  tae  screen 
(see  Fiqures  2 and  3) . 

This  metnod  can  he  used  to  display  aav  pyramid  data  structure, 
regardless  of  the  choice  of  reduction  window  size  and  reduction  rule. 
However,  since  each  level  is  sent  in  its  entirety,  ail  or  the  effort 
devoted  to  sending  levels  O-(L-I)  is  "wasted"  w^en  icvei  L completely 
overwrites  it.  When  the  reduction  window  is  2x2,  tnis  means  a 3 3. 3 .•> 
increase  in  transmission  time  for  the  rill  resolution  picture.  .ixso, 

I there  must  be  a small  amount  of  local  (to  the  display)  computation  and 

state,  which  interprets  the  sequence  of  pixel  values  arc.  Keeps  track 
of  such  things  as  tae  current  level,  tae  position  within  the  current 
raster  scan,  and  the  size  of  the  rectangles  to  be  pamteo.  A sc.  ill 
amount  of  preliminary  information  may  need  to  he  transmitted  i»  order 
to  initialize  this  local  comp  itat  ior..  Tnis  transmission  overhead  is 


negligible,  howeve 
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The  progression  of  images  produced  by  the  naive  receiver  id 
described  bv: 


(RR,f)  = % 
k=0 


% B((k,i,j),C  . .) 

0<i<2k 

0<j<2k 


where 


is  the  color  (value)  of  the  pixel  (k,i,i). 

The  order  of  terms  far  the  second  repainting  operator  does  not 
affect  the  final  result  in  this  case.  however,  the  progression  of 
iaaqes  is  affected  in  that  the  orcer  of  repainting  tr.a  blocks  of  a 
single  level  depends  on  tae  way  tars  operator's  radices  ore 
interpreted.  Se  can  simplify  this  expression  if  we  assuae  that  x will 
be  the  slowest  index  to  increase: 

(RR,f)  = % 3(  (k,i,  j ) ,C,  . .) 

0<k<L 

0<i<2k 

0<j<2k 
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NAIVE  SENDER 


begin  "send  image" 
for  level  :=  0 step  1 until  L 
uo  begin  "sand  level"  / 

fee  y :=  0 step  1 until  (N**level)  -1 
do  begin  "send  scan  line" 

for  x :=  0 step  1 until  (ii**level) -1 
do  Send  (Pyramid!"  le  vel , x , y U 
end  "send  scan  line" 
end  "send  level" 
end  "send  image" 


NAIVE  RECEIVER 


begin  "receive  image" 
for  level  :=  0 step  1 until  L 
do  begin  "receive  level" 

for  7 0 step  1 until  (N**level)-1 

do  begin  "receive  scan  line" 

for  x :=  0 step  1 until  (ft**le ve  1)  - 1 
do  begin  "receive  pixel" 

Receive  (pixel)  ; 


xl  : = 

X 

* 

Screendax X 

/ 

(M**  lev  el)  ; 

x2  : = 

(xH) 

* 

Screen’laxi 

/ 

(11** level)  - 1 ; 

yi  : = 

V 

* 

ScreeiulaxY 

/ 

(N**la vel)  ; 

y2  : = 

(y*i) 

♦ 

ScreenEaxY 

/ 

(N**level)  - 1 ; 

SetColor  (pixel) ; 
PaintRectangle  (x  1 ,y  1 , x2 , y2)  ; 
end  "receive  pixel" 
end  "receive  scan  line" 
end  "receive  level" 
end  "receive  image 


The  previous  method  used  a fixed  or  ler  or  pixel  t ransmissicn , auu 
used  knowledge  about  this  order  to  avoid  sendius  any  positioning 
information.  In  this  methou,  we  take  the  view  that  the  spatial 
coherence  of  the  image  is  such  that  there  are  large,  homogeneous  areas 
which,  once  painted  correctly  in  a low  resolution  image,  nee  i not  ho- 
over painted . This  is  often  the  case  ir:  binary  images,  and  h e-coses 
less  probable  as  the  grey  scale  or  color  resolution  is  increased. 

The  transmitted  information  consists  of  a sequence  of  quadruples 
( k,i, i, v)  , wne  re  : 

k.  = Level  number, 

i,  i = Coordinates  of  a pixel  at  taut  Level, 
v = The  Color  (or  Value)  of  tnat  pixel. 


Once 

again 

, we  transmit  the 

py  ra 

mid  from  the 

top 

1 o » a , o x c e p t 

that 

w s 

only 

send  a quadruple 

tor 

a Due,,  if  its 

Vox 

ue  is  different 

than 

tne 

Value 

of  its  Father  (in 

tne 

previous  Level) 

The  uispiav*  d 

images  will  be  the  same  as  those  produced  by  the  Naive  method,  the 

display  speed  will  depend  strongly  upon  the  "pyramid  complexity" 
‘Tamaoto,  1 977  ] of  tne  image. 

This  method  is  most  lively  to  oe  useful  when  tne  range  of  pixe.. 
values  is  small,  and  when  the  pyramid  is  grown  bv  a reduction  role 
such  as  a ode  (Value  of  Father  = most  common  Value  of  .sons).  In  these 
cases,  we  are  guaranteed  to  have  correct iv  Painted  at  least  1/  (.-.*:.)  of 
the  pixels  at  a given  level,  since  at  least  one  Sou  in  ?verv  reductio.. 

.v  i nd  o * . 


window  has  the  same  value  as  tne  ?at..er  o 


c n a - 
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This  method  is  unsuitaule  tor  tue  display  or  pyramids  gro«r»  tv 
reduction  rules  (e.g.  , dean)  which  do  not  guard  it  tea  exact  mutches 
between  Father  and  Son  pixel  values.  In  these  cases,  the  overhe.au 
involved  in  specifying  the  level  and  coordinates  or  each  pixel  will 
outweigh  the  savinqs  made  uy  not  sending  every  pixel. 

A special  case  arises  when  tne  images  are  binary  (1/1).  In  t.idt 
case  wa  are  guaranteed  that  at  least  1/2  of  the  pixeis  at  a given 
level  are  already  correct.  In  addition,  we  car  dispense  wita  the 
fourth  element  of  every  quadruple.  We  adopt  the  convention  tnat  the 
screen  is  originally  blank  (say,  ail  O's).  We  may  refer  to  tms  "Zero 
image"  as  level  -1.  Then,  the  Value  of  i qiven  quadruple  is  uniquely 
determined.  Hence,  it  need  not  be  sent.  Instead,  the  meaning  or  tne 
triple  (k,i,j)  becomes  "coaolement  the  olock  corresponding  to  position 
(i,  1)  at  level  k"  TTaniaoto,  197  7 ]. 

Of  course,  if  we  do  not  restrict  ourseLves  to  pyramid  data 
structures,  there  is  a large  ciass  of  successive  refinement  display 
methods  based  on  the  use  of  smaller  and  smaller  ractauguiar  (or  other 
shaped)  blocks.  The  tradeoffs  are  much  the  same  as  those  addressed  r,  y 
div ide-and-coaquer  hidden  surface  algorithms  [War nock,  19o9].  Note 
that  the  (k,i,i)  tciple  is  smaller  than  the  (XI  , jM  , X2 , Y2)  quadruple 
needed  to  specify  an  arbitrarily  placed  rectangular  block,  but  tr.it 
arbitrary  placement  allows  faster  localization  or  edges  w i c n uo  aut 
lie  on  the  pyramid's  reduction  window  boundaries.  Allowing  arritrarv 
placement  of  blocks  also  raises  the  question  of  efficient  ^etnods  of 
determining  an  optimal  painting  sequence.  iucu  c onsiue rations  ace 
beyond  the  scope  of  this  work. 
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Me  describe  the  progression  or  images  produced  by  the  explicit 
repainting  receiver  as  follows: 


(RR,f)  = % F((k  ,i  tj  - ),c  ) 

q7i  q q q q 


Here  the  sequence  of  quadruples  sent  by  the  explicit  repainting  sender 
is  represented  by: 


|ii  f iCi  ) , ( , i _ , j — * c — ) , • • • , (k  j i >3  it  ) • 

iiii  ii.ii  n n n n 

q q q q 


In  the  aforementioned  special  case  where  binary  (h  lack/ whi  te ) images 
are  concerned  (and  the  value  of  a given  quadruple  need  not  be  sent, 
since  it  is  implicitly  the  opposite  of  its  father's  value)  , we 
describe  the  explicit  repainting  receiver's  metises  as 


(RR,f)  = 3(0, 0,0),  black)  £ £ B((k  ,i  ,j  ),  white) 

q=i  q q q 


Thus,  successive  refining  in  this  case  is  equivalent  to  successive 


complementation  of  the  color  of  suboiocks. 


EXPLICIT  REPAIrtTIMJ  5 EX J EP 


beqin  "sand  iuaqe" 
send  (0,  0, 0,  Pyra^idf  0,0,0]); 
foe  Level  :=  1 step  1 until  L 
do  oeqin  "send  level" 

foe  v :=  0 step  1 until  (y**lev£l)-1 
do  beqin  "send  scan  line" 

for  x :=  0 step  1 until  (d**lava 1) -1 
io  beqin  "send  pixei." 

father  :=  ? vraxi  if  level- 1 , x/d,  y/'i  ] 
son  ;=  Pvraaidf level , x, y 1; 
if  son  NEQ  father 
theu  Send (level, x, y, son) 
end  "send  oixel" 
end  "send  scan  line" 
end  "send  level" 
end  "send  imaqe" 


EXPLICIT  3Z?A I N’TI  N J 32CEI7EB 


beqin  "receive  iaaqe" 
whila  TRUE 

io  beqin  "another  pixel" 

Receive  ( level  ,x,y  , pixel)  ; 


X 1 

: * x 

* 

ScreendaxX 

/ 

(M** level)  ; 

x2 

:=  ( x*  1) 

* 

Screen  .1  ix  X 

/ 

(.1** level)  - 

Vi 

: = v 

* 

Screen dux! 

/ 

(a** lev  el)  ; 

y 2 

s*  (y*lj 

♦ 

Screen lax i 

/ 

(N** level)  - 

SatColor  ( pixel)  ; 
PaintRectanqle (x 1 ,y1 , x2 , v2 ) 
end  "another  pixel" 
end  "receive  iaaqe" 
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OMIT  REDdMhAM  P IX  MLS  i S J 1 ) 

I ha  Waive  method  made  use  of  a specific  oriaring  of  the-  pi  xeis  m 
the  pyramid,  and  the  Explicit  Repaintin  g method  used  knowledge  (on  the 
Seader’s  part.)  about  oraviousty  scut  pixels  m order  to  avoid  sending 
"redundant"  information.  In  this  Qetnod,  we  raly  upon  knowledge  or. 
the  heceiver's  part  about  cue  values  of  previously  sent  pixeis  auu  the 
reduction  rule  used  in  growing  the  pyramid. 

Assume  we  are  working  with  scaiai  pixe^.  vaiies  (color  is  nandic-d 
by  assuminq  we  have  three  scaia  r- vai  ued  images).  Suppose  mat  tno 
reduction  rule  was  Sum  (Value  or  Fatucr  = Juiu  or  Values  or  Sols).  h 
first  note  that  each  level  of  the  pyramid  requires  a different  number 
of  bits  to  represent  each  pixex.  inert  the  reduction  winnow  is  2x2, 
level  k-1  roquiros  2 more  bits  per  pi<el  tain  level  k.  .<  ext,  «e  see 
that  if  we  know  the  values  of  the  Father  and  ail  but  one  of  the  Sons, 
then  we  can  derive  the  value  of  the  last  Sou.  For  example,  .its.  a 2x2 
reduction  window, 

Soaf  1,11  - Fatnar  - (Sonf  J ,0  ]tdon|  j,  1 ]+Jon[  1 , 0 ]) 


How,  if 

t he 

va 1 ues 

or  previously  sent 

1 1 Xfc 

xo  ICC 

rea 

llxV 

available  to 

the  Receiver 

( i . e • , 

toe  current 

i ma  g 

a is 

V 

i-i 

o 

f* 

in  1 

neaory  which 

can  be 

read 

c;  t.ie 

Receiving 

prog 

ass) 

, t o e i. 

A GJ 

J . i ii 

transmit  t he 

i aaqe 

a s 

in  r. he 

a i ve  met  hod  , 

t xc 

a pt 

t n a t we 

omit 

‘‘.l.  t* 

last  pixal  in 

each 

reduction  win 

d o w . 2 h e 

Seca 

i v i n 

'j  P r occ  ss 

>U  1 1 .0  L 

appropriately  scale  all  values  rot  display  purposes,  and  compute 
values  of  tha  "missing"  pixels. 
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Note  that  the  Receiver  aay  take  advantaje  or  the  increased 
qrey-scaie  resolution  in  tne  lower  spatial  resolution  levels.  For 
example,  an  imaqe  which  is  oinarv  at  level  L can  be  displayed  as  a 


qrey-sc 

ale 

imaqe  at  earlier  levels. 

This 

can  be  done  either  by 

usmq 

a qrey- 

scale 

display  device  or 

by 

usinq 

half-toninq  technique 

s to 

shade 

the 

rectanqular  blocks 

on  a 

binary 

display.  This  use  oi 

extra 

qrey-sc 

ale 

resolution  aay 

siqnif ic a nt ly  improve  tue 

ear  iy 

approximations  to  the  final  iaaqe. 

Since  we  omit  one  pixel  in  each  reduce  ion  window,  the  total 
number  of  pixels  transmitted  is  X*'/,  tae  number  of  pixels  in  level  L. 
However,  since  pixels  at  different  levels  require  aore  bits  to 
specify,  there  is  some  transmission  overhead  involved.  Tie  absolute 
overhead  is  independent  of  the  number  of  bits  par  pixel  in  level  L. 
For  a 2x2  reduction  window  and  12  bits  of  information  for  eacu  Uevei 
L)  pixel,  the  transmission  overhead  is  3.3.':.. 

The  proq ressioa  of  imaqes  produced  ov  this  receiver  is  identical 
to  that  produced  by  the  naive  receiver. 


I 
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cut  rrD'i'nvj:  pixii.5  (stjn)  senti? 


beqin  "stud  ioaqe" 
for  Level  :=  j s*eo  1 until  1 
d j iaeqin  "sc- nl  level" 

far  v :=  1 st  e d 1 until  ("♦’“level) -1 
lo  be  Tin  "send  scar.  Line" 

far  x :=  0 stto  1 until  (:•'.**  lave  i)  - 1 
lo  bcqin  "sen?,  oixel" 

if  ((v  .TOO  S)  "TO  N-1) 

OR  ({x  .iCO  .1)  MIC  K-1) 

Or  (level  = 0) 

‘.'ie  n 3 c nd  (P  vra.n  i If  level, x,v  ]) 
enl  "sen  1 oi xel  " 
end  "send  scan  line" 
end  "send  level" 
tad  "send  ixa}e" 


OTIT  R EOU'JOA  :i  T PIXELS  (ST*)  RECEIVER 


be  i in  "receive  ixaie" 
far  level  :=  C 1 until  L 

la  be  Tin  "receive  lev<~l" 

for  v :=  0 ptsn  1 until  ( N **1  svel)  - 1 
ic  It  ] in  "receive  scan  line" 

far  x :=  1 step  1 ant.  ii  ( .‘  ! * * i a v s 1 ) - 1 
lo  heqin  "receive  oix^i" 
if  ((v  TC  0 N)  c N-1) 

Of  ((X  .10  D T)  NEC  N-D 
C 3 ( le  v ?1  = 1) 
tber.  Tw'ce ive  (oixel) 
else  oixel  :=  c it  net  (x  , /) 

- Su.iPre  v LousSons  (x  , 
SaveV  a lur  ( lave  1,  x,  v , pixe  1)  ; 

Set  Co  lor  (pixel/ ( ( N * N ) **1  ■»"«!)  ) ; 


<1  :=  x * Screen N a xX  / (,!**leve. 

x2  : - ( x ♦ 1 ) * ScrtL°n."ax i / (I**  lave.! 

vl  :=  v * Screen  laxY  / (:;**lsve! 

v 1 : - ( v * 1 ; * Sc  reo  n v a x Y / ( N*  * 1c  ve  . 

"air. t Pec*  i..  il : (x  1,  v 1,  xC  ,v2) 
end  "recei/o  pixel" 
end  "receive  scan  line" 

"r-.-C-a  iv  ? !■:  ve  1" 


.3 
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OMIT  REDUNDANT  PIXELS  (SELECTION) 

The  previous  aethod  can  be  generalized  to  deal  with  any  reduction 
rule  which  allows  the  derivation  of  tue  Value  of  a single  Son  pixel, 
qiven  the  Values  of  the  Father  and  the  reaainiug  Sons.  In  particular, 
if  the  reduction  rule  is  Selection  (Value  of  Father  = Value  of 
Soafx'rV'Uf  then  not  only  can  we  avoid  sending  Sonfx' ,y'  1,  nut  we  do 
not  even  have  to  derive  its  value!  When  the  othar  Sons  are 
transmitted  and  painted  on  tne  screen,  SonCx'jV'l  is  already  correctly 
painted  on  the  screen.  The  area  corr espondi ng  to  Son[x',y'  1 was 
painted  when  the  Father  was  painted,  and  doss  not  neeu  to  be 
repainted.  The  important  point  is  that  both  the  Sender  and  the 
Receiver  can  Xnov  this.  As  above,  we  must  transmit  X*i  pixels. 


However,  due 

to 

our  choice  of 

reduction  rule,  ail 

pixels  require 

the 

same  number 

of 

bits.  This 

means  that  tnere 

is  absolutely 

no 

transmission  overhead,  coaoared  with  a row-by-row  painting  oi  level  L. 
The  advantages  of  early  presentation  to  the  user  of  a complete  , albeit 
low  resolution,  image  are  ontained  at  che  price  of  a siilx  amount  of 
computational  overhead.  Also,  it  is  not  necessary  to  store  tne  image 
in  fast  memory  accessible  to  the  Receiver,  since  m operations  otner 
than  display  are  reguired. 

The  values  transmitted  correspond  exactly  to  tue  values  or  the 
pixels  it  level  L.  The  order  in  wmch  thev  are  sent  is  tne  only 
difference  between  this  aetnod  and  the  traditional  row-Ly-row  raster 
scan.  Just  as  the  Receiver  must  understand  the  ordering  of  the  usiai 
raster  scan,  the  Receiver  for  tais  aethod  must  understand,  ana 
properly  interpret,  this  ordering.  If  the  time  to  write  a large 


OMIT  REDUNDANT  PIXELS  (SELECTION')  SENDER 


begin  “send  iaage" 
foe  level  :=  0 step  1 until  L 
do  begin  ”3 end  level" 

for  y :=  0 step  1 until  ( N ♦ ♦level)  - 1 
do  begin  "send  scan  line" 

for  x :=  0 step  1 until  (K**level)-1 
do  begin  "send  pixel" 

if  ( ( y 300  N)  HEQ  0)  OR  ( (x  MOD  tf ) M E2  0) 
DR  (level  = 0) 

then  Send  (Pyram idr level , x , v D 
end  "send  pixel" 
end  "send  scan  iiue" 
end  "send  level" 
end  "send  iaage 


OMIT  REDUNDANT  PIiELS  (SELECTION)  RECEIVER 


begin  "ceceive  iaage" 
for  level  :=  0 step  1 until  L 
do  begin  "receive  level" 

for  y :=  0 step  1 until  (N  ♦♦level)  - 1 
do  begin  "receive  scan  line" 

for  x :=  0 step  1 until  (M**level)  - 1 
do  begin  "receive  pixel" 

if  ((y  MOD  ;j)  HEQ  0)  OR  ((x  MOD  S)  N EQ  0)) 

33  (level  = 0) 

then  begin  "overuaint  with  son" 

Receive  (pixel)  ; 

SetColor  (pixel) ; 

xl  :=  x * ScreenMaxX  / («**  level); 

x2  :=  (x+1)  ♦ ScreeuilaxX  / (M**  level)  -1 

yl  :=  y ♦ ScreaaMaxY  / (N**levei); 

y2  :=  (y+  1)  ♦ Scr  sen  Max  Y / (j**  level)-  1 

Pdintiect angle  (x  1 , y 1 , x2,  v2> 
end  "overpaint  VLth  son" 
end  "receive  pixel" 
end  "receive  scan  line" 
end  "receive  level" 
ead  "ceceive  iaage" 
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INTERACTIVE  DETAILING 


All  of  the  above  methods  can  be  modified  to  allow  the  ooserver  to 
direct  the  successive  refinement  process.  Once  the  attire  i.uage  aas 
bean  painted  to  some  minimum  resolution,  the  user  may  interrupt.  tie 
transmission  of  the  image  and  indicate  an  area  to  be  refined  further. 
The  refinement  process  is  then  limited  to  taut  area  of  t..e  in  a je. 
This  will  prevent  tie  transmission  of  information  about  areas  or  t..e 
image  which  are  uninteresting  to  the  user,  and  aliov  much  raster 
refinement  of  the  important  details. 


The  Explicit  Eepainting  scheme  is  the  easiest  one 


to  nonary. 


since  the  position  and  extent  of  eacn  rectangular  l.oci  is  coup^ete! v 
specified.  The  other  methods  rely  upon  a fixed,  known  order  of  ti tei 
values,  and  must  be  exteuaed  to  deal  with  interruptions.  Arter  eacn 
user-specified  windowing  operation,  a small  amount  of  bookkeeping 
information  must  be  transmitted,  cm  re-init laiize  the  deceiver. 
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r a a :<s  ?o  r .1  s et  j 0 ds 

All  of  the  set  hods  discussed  above  yield  a "series" 
representation  of  the  image,  and  have  tne  "prefix  property".  That  is, 
truncatinq  t.ue  series  at  any  point  gives  an  ap  proximatiOi,  to  the 
ociqinal  imaqe.  There  are,  of  course,  other  representations  with  tais 
property.  Two  which  have  been  used  extensively  in  image  processing 
are  the  Fourier  and  Hadamard  transforms  [Andrews,  1J7Q].  The  primary 
difficulty  with  such  methods  is  the  amount  of  computation  required  to 
turn  the  representation  into  a visible  image.  If  this  is  to  it  done 
only  once,  after  complete  transmission  of  the  (truncated)  transform, 
then  this  aiqht  not  be  a serious  objection.  however,  it  is  no*-, 
immediately  clear  how  to  extend  these  aethods  to  interactive  detailing 
in  the  spatial  domain. 

The  aethods  we  have  descrioed  have  the  additional  property  taat 
they  are  well  matched  to  tae  display  capabilities  of  available  raster 
qcaphics  equipment.  For  example , painting  a rectangular  block  is 
essentially  free  on  many  display  devices.  Also,  our  methods  can 
easily  be  implemented  requiring  neither  mu  itipli  cat  ion  nor  division 
operations.  Since  the  display  equipment  proviias  tae  transform 
inversion,  this  means  that  rapid,  repeated,  incremental  conversion  of 
the  series  representation  into  a viewable  image  is  feasible. 


CONCLUSION 


The  widespread  use  of  high  resolution  raster  graphics  msplavs 
will  require  effective  use  of  low  bandwidth  coaaunication  lines.  i,e 
have  presented  several  aethods  of  transmitting  raster  images  wnich 
provide  early  recognition  of  gross  features  and  which  are  wen.  matched 
to  available  display  devices.  Tae  use  of  these  methods  is  t>y  no  means 
restricted  to  display  applications.  They  are  suitaole  for  any 
situation  in  wnich  the  Receiver  can  make  use  of  a low-resolution 
image,  especially  when  the  required  resolution  is  not  known  a priori. 
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